COMMENSURABILITY OF GEOMETRIC SUBGROUPS 
OF MAPPING CLASS GROUPS 



MICHAL STUKOW 

Abstract. Let M be a surface (possibly nonorientable) with punc- 
tures and/or boundary components. The paper is a study of "geo- 
metric subgroups" of the mapping class group of M, that is sub- 
groups corresponding to inclusions of subsurfaces (possibly discon- 
nected). We characterise the subsurfaces which lead to virtually 
abelian geometric subgroups. We provide algebraic and geometric 
conditions under which two geometric subgroups are commensu- 
rable. We also describe the commensurator of a geometric sub- 
group in terms of the stabiliser of the underlying subsurface. Fi- 
nally, we show some applications of our analysis to the theory of 
irreducible unitary representations of mapping class groups. 



1. Introduction 

Let Mg r be a smooth, compact, connected surface of genus g with 
s punctures and r boundary components (we will call them holes). If 
r and/or s is zero then we omit it from notation and if we do not 
want to emphasise the numbers g, r, s, we simply write M for a surface 
Mg . If r = 0, we call M a closed surface. For the sake of notational 
convenience we will use the convention that nonorientable surfaces have 
negative genus, hence M_ g is a connected sum of g projective planes, 
for g > 1. 

If M is a nonorientable surface, define the mapping class group 
A4(M) of M to be the group of isotopy classes of diffeomorphisms 
of M, where we assume that both diffeomorphisms and their isotopies 
fix the set of punctures and are the identity on the boundary of M. 
The mapping class group of an orientable surface is defined analogously, 
but we consider only orientation preserving maps. In order to simplify 
some statements, we define A4(0) to be the trivial group. 

Recall that two subgroups H 1 and H 2 of a group G are commensu- 
rable if HiC\H 2 is of finite index in both Hi and H 2 . The commensurator 
of H < G is defined to be 

Comm(i7) = {g G G \ H and gHg^ 1 are commensurable}. 
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It is not hard to check that if Hi and H2 are commensurable sub- 
groups of G, then 

Comm(ifi) = Comm(i/2)- 

In particular, commensurator is invariant under passing to a finite index 
subgroup. 

The main goal of this paper is to study a family of geometric sub- 
groups of Ai(M), that is the subgroups of the form i*(Ai(N)), where 
i* is a homomorphism induced by the inclusion %: N — > M. To be more 
precise, i* is a map that extends a diffeomorphism of a subsurface N 
of M to a diffeomorphism of M. In particular, we 

• describe the kernel of 2* - Theorem 3.6; 

• describe subsurfaces which lead to virtually abelian geometric 
subgroups - Theorem 5.1; 

• give an algebraic and geometric characterisation of geometric 
subgroups that are commensurable - Theorems 6.3, 7.1 and 
7.3; 

• relate the commensurator of a geometric subgroup with the 
stabiliser of the corresponding subsurface - Theorems 8.3 and 
8.4. 

Finally, in section 9 we provide some straightforward applications of 
the above results to the theory of unitary representations of mapping 
class groups - cf Corollary 9.8. 

Some of our results were previously known in the case of a connected 
subsurface of an orientable surface [12, 13]. The novelty of our work is 
that we allow the subsurfaces to be disconnected and not necessarily 
injective (i.e. i*: Ai(N) — > M.(M) does not need to be injective). The 
main motivation for this general notion of a geometric subgroup was to 
include the very important family of subgroups of Ai(M), namely the 
stabilisers of simplexes in the complex of curves on M - cf Example 
3.5. Moreover, we do not require M to be orientable. The extension to 
the nonorientable case is possible by the recent results obtained in [16]. 

2. Preliminaries 

2.1. Definitions. By a circle in M we mean an unoriented simple 
closed curve in the interior of M which is disjoint from the set of punc- 
tures. Usually we identify a circle with its image. If ai and a<i are 
isotopic, we write ai ~ a^. Moreover, as in the case of diffeomor- 
phisms, we will use the same letter for a circle and its isotopy class. By 
a boundary circle we mean a circle parallel to a boundary component 
of M. 
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According to wether a regular neighbourhood of a circle is an annulus 
or a Mobius strip, we call the circle two-sided or one-sided respectively. 
We say that a circle is essential if it does not bound a disk disjoint 
from the set of punctures, and generic if it bounds neither a disk with 
fewer than two punctures nor a Mobius strip disjoint from the set of 
punctures. Notice that the surface M s g r admits a generic two-sided 
circle if and only if M is not M$ r with 2r + s < 3 nor M s _ lr with 
2r + s<2. 

Let a be a two-sided circle. By definition, a regular neighbourhood 
S a of a is an annulus, so if we fix one of its two possible orientations, 
we can define the right Dehn twist t a about a in the usual way. We 
emphasise that since we are dealing with nonorientable surfaces, there 
is no canonical way to choose the orientation of S a . Therefore by a 
twist about a we always mean one of the two possible twists about a 
(the second one is then its inverse). By a boundary twist we mean a 
twist about a circle parallel to a boundary component. It is known that 
if a is not generic then the Dehn twist t a is trivial. In particular a Dehn 
twist about the boundary of a Mobius strip is trivial - see Theorem 
3.4 of [4]. 

If z\ and z 2 are two punctures in a surface M then there exists 
their common neighbourhood which is a disk. Hence we can define an 
elementary braid on z\ and zi- It is known that the mapping class 
group of an orientable surface is finitely generated by Dehn twists and 
elementary braids [1, 7, 8, 10]. 

Other important examples of diffeomorphisms of a nonorientable sur- 
face are the crosscap slide and the puncture slide. They are defined as 
a slide of a crosscap and of a puncture respectively, along a loop. It 
is known that the mapping class group of a nonorientable surface is 
finitely generated by Dehn twists, elementary braids, puncture slides 
and crosscap slides [3,6,9,15]. 

2.2. Examples. It is well known that the mapping class group of M 
is trivial if and only if M = M$ r with r,s E {0, 1} or M = Mi l r with 
s = and r < 1. 

The mapping class group of an annulus or an annulus with a punc- 
ture is generated by boundary twists and is isomorphic to Z or Z x Z 
respectively. As for less trivial examples, the mapping class group of a 
torus or torus with one puncture is generated by twists about meridian 
and longitude and isomorphic to SL(2,Z). Another nontrivial exam- 
ple is the mapping class group of a disk with n punctures which is 
isomorphic to the braid group on n strings. 
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As for nonorientable surfaces, the mapping class group of a projective 
plane with one or two punctures is generated by puncture slides and 
is isomorphic to Z 2 or the dihedral group D 4 (of order 8) respectively 
- see Corollary 4.6 of [6]. The mapping class group of a Klein bottle 
is generated by a twist and a crosscap slide [9], and is isomorphic to 
Z 2 x Z 2 . The description of mapping class groups of a Klein bottle 
with one puncture and a Klein bottle with one hole can be found in the 
appendix to [16]. In particular, we will use the following proposition. 

Proposition 2.1. Let M be a Klein bottle with one hole. Then 

(1) there are exactly two isotopy classes of generic two-sided circles 
in M, namely the isotopy classes of a boundary circle b and of 
a nonseparating two-sided circle a in M (see Figure 1); 




FIGURE 1. Generic two-sided circles on a surface M_ 2 ,i- 

(2) the group generated by Dehn twists t a and t b is an index two 
subgroup of A4(M) and is isomorphic to Z x Z. 

Proof. The idea of the proof of assertion (1) is very simple, first one 
observes that if c and d are generic two-sided circles of the same sep- 
arability (i.e. both are separating or nonseparating) then there exists 
a diffeomorphism h: M — > M such that h(c) ~ d. Then from the 
structure of the mapping class group of M (cf Theorem A. 7 of [16]) 
one concludes that for every h E M(M) ) h(a) ~ a and h(b) ~ b. We 
omit the details, refereing the reader to the fully analogous proof of 
Proposition A. 3 in [16]. 

Assertion (2) is a consequence of Theorem A. 7 of [16]. □ 

2.3. Pantalon &t skirt decompositions. Following [13], we call the 
surfaces M^ ± , Mq 2 and M 0j 3 pantalons of type I, II and III respec- 
tively (cf Figure 2). We say that a collection of different two-sided 
circles a±, . . . , a n on M define a pantalon decomposition of M if each 
connected component of M \ (J" =1 a, is a pantalon. It is known [13] 
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Type I Type II Type III 




Type I Type II 



Figure 2. Different types of pantalons and skirts. 

that an orientable surface has a pantalon decomposition if and only if 
2g + r + s > 2 and M ^ M 3 . 

As observed in Section 5 of [16], one needs to add two more "pieces" 
in order to decompose nonorientable surfaces, namely a Mobius strip 
with one puncture and a Mobius strip with an open disk removed. We 
call these surfaces a skirt of type I and II, respectively (cf Figure 2). A 
decomposition of a surface into pantalons and skirts is called a P-S de- 
composition. The nonorientable surface Mg r has a P-S decomposition 
if and only if r + s — g > 2 and M ^ M 2 ^. 

The mapping class groups of pantalons of type II, III and of a skirt of 
type II are generated by boundary twists and isomorphic to Z 2 , Z 3 and 
Z 2 respectively. The mapping class groups of a pantalon of type I and 
of a skirt of type I are isomorphic to Z and generated by an elementary 
braid and a puncture slide along a one-sided loop respectively. 

2.4. Properties of circles. For any two circles a and b, we define 
their geometric intersection number: 

I(a, b) = inf{|a n b\ : a' ~ a}. 

In particular, if a is a two-sided circle and a ~ b then I(a, b) = 0. 

Proposition 2.2 (Propositions 3.8 of [13] and 4.4 of [16]). Suppose 
M ^ M_ 2 and let a±, . . . ,a n be generic, pairwise nonisotopic, pairwise 
disjoint and two-sided circles on M. Then the homomorphism 

h: Z n ^ M(M) 

defined by 

Mai,...,a B )=C-"C 
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is injective. □ 

Proposition 2.3 (Propositions 3.7 of [13] and 4.7 of [16]). Let a and 

b be generic two-sided circles in M. If a and j3 are nonzero integers 
such that t a a tl = t%t2, then I (a, b) = 0. □ 

Although the following proposition is stated in [13] only for orientable 
surfaces, the proof applies to the nonorientable case verbatim. 

Proposition 2.4 (Proposition 6.2 of [13]). Suppose ai,...,a n are es- 
sential two-sided circles which are pairwise disjoint. Let b be an essen- 
tial two-sided circle such that I(a,i,b) = for all i = 1, . . . ,n. Then 
there exists a two-sided circle c isotopic to b such that Oj fl c = for all 
i — 1, . . . , n. □ 

Proposition 2.5. Let A = {ai, . . . , a n } and B = {b±, . . . , b n } be two 

collections of pairwise disjoint, essential and two-sided circles on M 
such that ai is isotopic to b{, for each i = 1, . . . ,n. Then there exists 
an isotopy h t : M — > M such that ho is an identity and h\(A) = B. 

Proof. We will use induction on the number m of isotopy classes of 
circles that have more than one representant in A. For m = the 
statement follows from Proposition 3.10 of [13] (although the state- 
ment in [13] is only for orientable surfaces, the proof applies to the 
nonorientable case verbatim). 

Now assume that m > 1 and up to the permutation of elements of 
A and B we can assume that a\ ~ a 2 — . . . — for 2 < k < n and 
a\ 9^ a,j for j > k. Applying the inductive hypothesis to the collections 
A' = {a-k, Ofe+i, • • • , a n } and B' = {bk, bk+i, ■ ■ ■ , b n } we obtain an isotopy 
h' t : M -> M such that h' is the identity, h[(A') = B' and h[(a k ) = 
bk- Clearly the isotopies a\ ~ a 2 — ■ ■ ■ — provide a family of 
annuli between the circles {a\, . . . , a^}. Let A be a maximal one with 
respect to inclusion. Hence {ax, . . . , a^} C A and dA C {a 1? . . . , a^}. 
If we define B in a similar manner but with respect to the circles 
{&i . . . , b k }, then h[(A) and B, as regular neighbourhoods of h'^ak) = 
bk, are isotopic by an isotopy h": M — > M. Moreover, since both h[(A) 
and B are disjoint from bk+i, ■ ■ ■ ,b n , we can assume that h"(bi) = bj 
fori = k + 1, . . . , n. Finally, let h'" : M — > M be an isotopy of B — 
h'lh'^A) which transforms ^'/(^({ai, . . . , a k })) onto {b± : . . . , bk}- Then 
the composition h t (x) = h'"(h"(h' t (x))) is a required isotopy between 
A and B. □ 

Lemma 2.6. Let a$ and ai be two disjoint, generic, nonisotopic and 
separating circles on a surface M such that one of the connected com- 
ponents of M \a,i is a Klein bottle K; L with one hole for i — 0,1. Then 
K nK 1 = 0. 
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Proof. Suppose that K n K x ^ 0. If X C K x or C X then one 
easily concludes that a ~ a±, hence we can assume that this is not the 
case. Therefore Oq intersects Ki, hence it is contained in the interior 
of K\. By part (1) of Proposition 2.1, this implies that a ~ a±, a 
contradiction. □ 

2.5. Some basic properties of a subgroup index. For the sake 
of completeness we review below some basic properties of a subgroup 
index. Throughout this section we will use the notation G//H for the 
set of left cosets of H in G. 

Proposition 2.7. Let ip: G — > (p(G) be a group homomorphism and 
assume that H is a finite index subgroup of G. Then <p(H) is a finite 
index subgroup of (p(G). In particular, a homomorphic image of a 
virtually abelian group is virtually abelian. 

Proof. Define a map $: cp(G)//(p(H) — > G//H as follows: 

<!>(<p(g)<p(H)) = gH, 

where we choose one g E G for each coset in (p(G) //<p(H). It is straight- 
forward to check that $ is "1-1". □ 

Proposition 2.8. Let H be a finite index subgroup of a group G, and 
let K < G be any subgroup. Then H n K has finite index in K . 

Proof. Define a map $: K//(H n K) -> G//if as follows: 

<f>(g(HnK))=gH, 

where we choose one g G G for each coset in Kjj (HnK). It is straight- 
forward to check that $ is "1-1". □ 

Proposition 2.9. Let Hi < Gi be a finite index subgroup for i — 0,1. 
Then H x Hi has finite index in Go x Gi. 

Proof. The assertion follows from the well know (and easy to check) 
formula: 

[Go x Gi : H x Hi] = [Go : H ][Gi : Hi] 

□ 

Proposition 2.10. Let H , Hi,K be subgroups of a group G such that 
K centralises both H and H\. If H and Hi are commensurable then 
H K and HiK are also commensurable. 

Proof. Since H and Hi are commensurable, by Proposition 2.9, 

(H C)Hi)xK 
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is a finite index subgroup of both HqX K and Hi x K . Moreover, since 
K centralises H and Hi, we have homomorphisms ipi\ Hi x K — > G 
defined by ipi(h,k) = hk, for 2 = 0, 1. Therefore by Proposition 2.7, 
(i^o H Hi)K is a finite index subgroup of both H K and H\K. This 
finishes the proof, since it is straightforward to check that 

(H n Hi)K < H Q K n 

□ 

The following example shows that the implication in the statement 
of Proposition 2.10 can not be in general replaced by an equivalence, 
even if we assume that HiK — H © K for % — 0, 1. 

Example 2.11. Let G — (a, b | [a, b}) be a free abelian group of rank 2, 
and let H = (a), Hi = (ab), K — (b). Then 

G = H ®K = Hi®K 

but H nHi = 1. 

3. Subsurfaces and injectivity 

Following [13], define an exterior cylinder E of a subsurface N C M 
to be any component oi M\N that is an annulus with both boundary 
circles a and 6 in N. In what follows, we will always assume that the 
orientations of regular neighbourhoods of a and b agree with the chosen 
orientation of E. In other words, twists t a and U are equal in Ai(E). 

Definition 3.1. Let N ^ M be a closed subsurface of M (not neces- 
sarily connected) . We call N an essential subsurface if the following 
conditions are satisfied 

(1) every boundary component of N is generic in N and N is dis- 
joint from DM; 

(2) for every connected component C of N which is an annulus, the 
meridian of C is not isotopic in M to a boundary component 
ofN\C; * 

(3) no component of M \ N is a disk. 

The first of the above conditions means that N has no components 
with trivial mapping class group, that is components homeomorphic 
to a disk with less than two punctures or a Mobius strip. The second 
one implies that the generator of the mapping class group of C does 
not belong to Ai (N \ C) . Therefore, from a mapping class group point 
of view, these two assumptions are quite natural and it turns out that 
they greatly simplify some arguments. The third condition is technical 
and it implies the following proposition. 
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Proposition 3.2 (Proposition 3.5 of [13]). Let N be an essential sub- 
surface of M and let a, b be essential two-sided circles in N such that 
a in not a boundary circle of an exterior cylinder to N. Then a and b 
are isotonic in M if and only if they are isotonic in N. □ 

As an immediate corollary we obtain: 

Proposition 3.3. Let a, b be essential circles in an essential subsurface 
N of M, and let I^(a,b) denote the geometric intersection number of 
a and b treated as circles in N. Then ijv(a, b) = I (a, b). □ 

Keeping in mind the above propositions we will often abuse notation 
by identifying isotopy in iV with isotopy in M and In(o>, b) with I (a, b). 

In some of our applications we will need to impose some further 
conditions on subsurfaces. 

Definition 3.4. We call an essential subsurface N C M generic if 
every boundary component of N is generic in M (hence does not bound 
a disk with less than 2 punctures nor a Mobius strip). 

Example 3.5. Let X n (M) be the set of n + 1-tuples (a , . . . , a n ) of one- 
sided and generic two-sided disjoint circles in M, such that a$ is not a 
boundary circle of M and a* is not isotopic to a,- for i ^ j. We say that 
two elements (do, • • • , a n ) and (bo, . . . , b n ) of X n (M) are equivalent if 
there exists a permutation s : {0, . . . , n} — > {0, . . . , n} such that Oj is 
isotopic to 6 s (j) for i — 0, . . . , n. 

Define the complex of curves C (M) to be an abstract simplicial com- 
plex such that the n-simplexes in C(M) are the equivalence classes of 
elements of X n (M) with respect to the equivalence relation defined 
above. Clearly we can think of elements of C(M) as sets of isotopy 
classes of pairwise disjoint circles. 

Every element a G C(M) provides a natural example of an essential 
subsurface M a of M, namely M a is the complement of a regular neigh- 
bourhood of a U dM. Observe that M a is a generic subsurface if and 
only if o does not contain one-sided circles. 

Consider an essential subsurface N C M and the homomorphism 
'■ M.(N) — > M.(M) induced by inclusion. If we do not want to 

emphasise the subsurface N , we simply write i* for i^ . The following 

theorem describes the kernel of i*. 

Theorem 3.6. Let N be an essential subsurface of M ^ M_2 and let 
C\, . . . , C p be components of N that are annuli. Denote by 
the boundary components of N \ Uf=i C« that are not generic in M , 
and let c\, . . . ,c m be these meridians of C\, . . . ,C P that are not generic 
in M. Denote also by bi, b' i} for i = 1, . . . , k, the pairs of boundary 
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components of N \ IJf=i C« that bound exterior cylinders. Then the 
kernel of C is generated by {t ai , . . . , t an , t ci , . . . , t Cm , t^ty t^H b > k } . 
Moreover, this kernel is isomorphic to Z n+m+k . □ 

Proof. The proof is very similar to the proof of Theorem 4.1 of [13], so 
we only give the main idea, refereing the reader to [13]. 

Since iV is essential, N \ IJ?=i Ci nas a P~S decomposition. Let 
di, . . . , d u be the union of circles defining this decomposition and these 
meridians of C\, . . . , C p that are generic in M. Let e±, . . . , e w be the 
boundary components of N \ \J p i=1 Cj different from all of at and bi, b\ 
(see Figure 3). 




Figure 3. Subsurface N - Theorem 3.6. 



Let h G keri*. Since h, as an element of Ai(M), is isotopic to the 
identity in M, h(di) ~ di in M for % — 1, . . . , u. By Proposition 3.2, 
h(di) ~ di in N, hence by Proposition 2.5, we can assume that h, 
as an element of Ai(N), is the identity on each of d\, . . . ,d u and on 
boundary curves of N. Moreover, since isotopies fix punctures, h does 
not permute them and does not reverse the local orientations around 
them. Therefore, by the structure of mapping class groups of pantalons, 
skirts and annulus, we conclude that 



h = t" 1 --- t^'S ■ ■ ■ tl k Sfl) ■ ■ ■ Vrt*} ■ ■ ■ t 5 ft £ p ] 



4-Sw 



t £m 



for some integers a,, Pi, ft, r yi,5i,e i . Therefore 

By Proposition 2.2, 

A + # = ... = fa + (3' k = 5 1 = ... = 5 U = e l = ... = e w = 0, 

which proves that ker i* = (t ai , . . . , t an , t Cl , . . . , t Cm , t^ty t^ty k ) , 
and kerL = Z n+m+k . □ 
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Definition 3.7. // the homomorphism i*: A4(N) — > A4(M) is injec- 
tive, we call N an injective subsurface. In such a case we usually 
identify i*(M(N)) withM(N). 

An injective subsurface is of course generic, however a generic sub- 
surface can have exterior cylinders. 

Corollary 3.8. Let N be an essential subsurface of M and M is not 
a torus. Then N is injective if and only if no component of M\N is 
a disk with less then two punctures, Mobius strip or an annulus whose 
boundary components are both boundary components of N. □ 

Observe that the above corollary can be thought as a generalisation 
of Proposition 2.2. In fact, Proposition 2.2 follows for N being an union 
of disjoint regular neighbourhoods of appropriate circles. 

Corollary 3.9. Let Ui, . . . , U p be connected components of an essen- 
tial subsurface N of M. Then the geometric subgroup i*(A4(N)) is 
isomorphic to the quotient of the product Y\i=i i*{M-{Uij) by the sub- 
group generated by {t^Hy^ . . . , t^Hy k }, where bi, b[, . . . , 6fc, b' k are pairs 
of boundary components of N that bound exterior cylinders. □ 

Proposition 3.10. Let N be an essential subsurface of M and assume 
that N is not a Klein bottle with one hole. Let a be a two-sided generic 
circle in N which is not a boundary circle of N . Then there exists a 
two-sided circle b in N, which is generic in M, and I(a,b) > 0. 

Proof. For M = M_2 the statement is trivial, hence assume that M ^ 
M_2. By Proposition 3.4 of [13] and Lemma 4.1 of [16] there exists a 
circle b, generic in N, such that I(a, b) > 0. In particular b is not a 
boundary circle of N, hence by Proposition 2.2 and Theorem 3.6, the 
twist tb is nontrivial in M, that is b is generic in M. □ 

4. DlFFEOMORPHISMS OF SUBSURFACES AND THEIR ISOTOPIES 

The main goal of this section is to prove Proposition 4.4 which, 
roughly speaking, characterises isotopy classes of diffeomorphisms of 
an essential subsurface iV which have representants with support dis- 
joint from N. This result will be an essential tool in proving a partial 
converse to Proposition 2.10 - see Lemma 6.2. 

Lemma 4.1. Let U be a sum of some of the connected components 
of an essential subsurface N of M (see Figure 4)- Suppose that f e 
M.{M) is such that f e i*{M.{N)) and the support of some represen- 
tant of f is disjoint from U. Then 
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where g G i*(M.(N \ U)) and each of b±, . . . ,bk is a boundary circle 
ofU. 




Figure 4. Subsurfaces iV and M a - Lemma 4.1. 



Proof. Since the proof is quite technical, we will first explain the main 
idea. We know that the isotopy class of / contains two representants 
fi and f 2 such that f± acts trivially outside iV and f 2 acts trivially on 
U. What we are going to show is that in fact, up to the twists about 
boundary components of U, f can be represented by a diffeomorphism 
g which shares these two properties, that is the support of g is contained 
in N\U. The idea of the construction of g is to glue the action of /i 
on N \ U with the action of f 2 on U. In order to do this rigorously, we 
will use Theorem 3.6. 

Observe that if U contains a component C homeomorphic to an 
annulus and U' — U\C, then under the same assumptions about /, it 
is enough to prove that 

where g' G i*{M.{N \ U')) and bi, . . . ,bk are boundary circles of U' . 
In fact, this is an easy consequence of the fact that the mapping class 
group of C is generated by a boundary twist. Therefore we can assume 
that U does not contain an annulus as a component. Assume also that 
U 7^ and M \ U is not a collection of disjoint annuli - in such cases 
the assertion is obvious. 

Let a be the set of isotopy classes of the boundary circles of U which 
are not boundary circles of M. Define M a to be a complement of a 
in M as in Example 3.5 - see Figure 4. By an appropriate choice of 
regular neighbourhoods of elements of a we can assume that U is a 
sum of connected components of M a (we use here the assumption that 
U does not have annuli as connected components). Moreover, since 
M\U is not a collection of annuli, M& ^ U . 

Since / G i*(A4(N)), there exists a diffeomorphism fi G Ai(NnM a ) 
such that i^ ItT {fi) = f ■ On the other hand, / has a representant f 2 with 
support disjoint from U . By composing / with some powers of twists 
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about meridians of the components of M \ M a which are annuli, we 
can assume that the action of f 2 on each such annulus is trivial. Hence 
we can treat f 2 as an element of M(M a \ U). The basic properties of 
fi and f 2 are as follows: 

(1) <J tf '(/i)=<J tf -(/ 2 )=/, 

(2) the action of f 2 on U is trivial, 

(3) the support of /i is contained in N. 
By Theorem 3.6 and assertion (1) above, 

h - hhi \ h k \ i 

where u is a product of some powers of boundary twists in U such 
that = 1, bi, . . . , bk and b[, . . . , b' k are boundary circles in U and 

M a \ U respectively such that bi is isotopic to b\ in M, for % — 1, . . . , k. 
By property (2), we obtain that 

is an element of Ai(M a ) which acts trivially on U. By Corollary 3.9, 

M{M a ) =M{M C \ U) ®M{U), 

hence we can change the action of g on U to the identity without 
changing its action on M a \ U. In other words, using (3), we can 
assume that the support of g is contained in N \ U. Therefore 

/ = <.(/!) = <.(<•••«£«) = <••<*, 

which completes the proof. □ 

Lemma 4.2. Let N be an essential subsurface of M, and let ai, . . . , a n 
be pairwise disjoint, generic and two-sided circles on M such that 
cii fl iV = for i — 1, . . . , n. If the product of twists 

J.Ctl ±ct n 

is an element of ' i*(JA(N)) for nonzero integers ai, . . . ,a n , then each 
of the ai, . . . , a n is isotopic in M to a boundary component of N. 

Proof. If M — M_ 2 then the assertion follows from the fact that there 
is only one generic circle in M_ 2 - see [9]. Therefore assume that 
M ^ M ,. 

If we apply Lemma 4.1 with U = N and / = ■ ■ -t"™, we obtain 

+«1 -l-Otn J./3l ,f3 k 

L ai " ' L a n — L b 1 " ' L b k > 

where each of b\ , . . . , bk is a boundary circle of iV which is generic in 
M. By Proposition 2.2, each a, is isotopic to some by □ 
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Lemma 4.3. Let C be a connected component of an essential subsur- 
face N of M which is an annulus with meridian c. Let K be an essential 
subsurface of M which do not have boundary circles isotonic in M to 
c. Suppose that f G JA(M) is such that f G i*(A4(N)) and the support 
of some representant of f is contained in K. Then f G i*(JA(N\C)). 

Proof. By Lemma 4.1, 

(1) f^ffZ, 

where g G u(M(N\C)). 

Since both / and tj act trivially on dK, we can decompose g ~ <7i<72, 
for diffeomorphisms <?i, <?2 G i*(.M(iV\C)) such that supp(gi) C N\K 
and supp((72) Clearly we can assume that C is disjoint from K, 

hence K = K U C is an essential subsurface of M. Since f ) g2,tj G 
i*(A^(i^)), equation (1) implies that gi G i*(.M(lT)). Hence applying 
Lemma 4.1 with f = g±, N = K and U = K, we obtain 

where each of bi, . . . , bk is a boundary circle of K. We claim that none 
of these circles is isotopic to c. In fact, since 

t---t k ^ 9l ei*(M(N\C)), 

by Lemma 4.2, we obtain that each of bi, . . . , bk is a boundary circle of 
N\C. 
Therefore 

< • • - 91% - gig' 1 ! - 92f e ^(M(K)). 

Since 6j ^ c for i = 1, . . . , k, Lemma 4.2 implies that 7 = 0. □ 

Proposition 4.4. Let U be a sum of some of the connected compo- 
nents of an essential subsurface N of M , and let K be an essential 
subsurface of M such that K C\U — and KUU is essential. Suppose 
that f G M.{M) is such that f G i*(A4(N)) and the support of some 
representant of f is contained in K. Then 

/ = <•••<*, 

where g G i*(A4(N \ U)) and each of bi, . . . ,bk is a boundary circle of 
both U and K . 

Proof. By Lemma 4.1, 

f _ n fPl . . . fPkfyi y-7m 
J — g l b X L b k i C 1 ■ ■ ■ L C m ) 
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where g G i*(A4(N \U)), bi, . . . , bk are the boundary circles of both U 
and K and c 1? . . . , c m are boundary circles of U which are not boundary 
circles of K. Hence it is enough to show that 71 = • • • = 7 m = 0. 

Let Ci be a regular neighbourhood of q disjoint from N \ U for 
1 < i < m, and let 

m 

N=(N\U)u[jC r 

For a fixed 1 < j < m, applying Lemma 4.3 with N = N, C = Cj, 
K = K and f — f, we obtain that / G i*(M(N \Cj)). Hence, by 
Corollary 3.9, 7^ = 0. □ 

The following simple example is an attempt to convince the reader 
that the above proposition is quite interesting in its own right because 
it provides some constraints on possible relations in the mapping class 
group. 

Example 4.5. Suppose that M is a torus with two holes and let the 
circles ai,a 2 ,a 3 ,bi,b 2 be as in Figure 5(i). Then, with an appropriate 




Figure 5. Torus with 2 holes - Example 4.5. 

choice of orientations of regular neighbourhoods of these circles, there 
is a "torus with two holes" relation in the mapping class group [5], 
namely: 

We claim that Proposition 4.4 implies that the above relation can not be 
"resolved" with respect to any of the twists on the left hand side. To be 
more precise, we concentrate on the twist t ai . We claim that if a ^ 
then t% is not an element of the group generated by the remaining 
twists. In fact, otherwise iV=regular neighbourhood of a 2 U a 3 U b\ U b 2 , 
fC=regular neigbourhood of ai, £/=regular neighbourhood of b\ U b 2 
and / = would satisfy the assumptions of Proposition 4.4, hence 

Ce^(JV\[/))H^,U. 
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In order to see that the above relation can not hold, consider M as 
a subsurface of M — M 3 as shown in Figure 5(ii). By Theorem 3.6, 
we can consider M.(M) as a subgroup of M(M) and now it is clear 
that the twist t c commutes with both t a2 and t as , where c is a circle 
indicated in Figure 5(h). On the other, by Proposition 2.3, t" does 
not commute with t c . 

5. Virtually abelian geometric subgroups 

Theorem 5.1. Let N be an essential subsurface of M. Then the geo- 
metric subgroup i*(Ai(N)) is virtually abelian if and only if N is a 
disjoint union of Klein bottles with one hole, skirts, pantalons and an- 
nuli. 

Proof. Suppose first that N is a disjoint union of Klein bottles with 
one hole, skirts, pantalons and annuli. Since the mapping class group 
of each of the listed surfaces is virtually abelian, 2*(.M(iV)) as a ho- 
momorphic image of a virtually abelian group is virtually abelian (cf 
Corollary 3.9 and Propositions 2.7, 2.10). 

Conversely, let i*(M.(N)) be virtually abelian and suppose that iV 
has a component, say U, which is not a Klein bottle with a hole, skirt, 
pantalon nor annulus. Then there exists a generic two-sided circle a in 
U which is not isotopic to a boundary component of U . By Proposition 
3.10, there exists a generic two-sided circle b in U such that I (a, b) > 0. 
On the other hand, since i*(M.(N)) is virtually abelian, i*(t%) and 
i*(tfr) commute for some nonzero integers a and (3. But i*(t%) and 
i*(t%) are just t" and t% treated as elements of A4(M). Hence, by 
Proposition 2.3, I(a, b) = which is a contradiction. □ 

Corollary 5.2. Let N be a generic subsurface of M ^ M_2 such that 
i*(JA(N)) is virtually abelian. Then there exist two-sided generic cir- 
cles cli, ... ,a n in N such that the subgroup (t ai , . . . , t an ) is a finite index 
subgroup of i*(A4(N)) and is isomorphic to II 1 . Furthermore, the cir- 
cles with the above properties are unique up to a permutation 
or replacing one of the boundary components of an exterior cylinder to 
N with the second one. 

Proof. Define the circles ai, . . . , a n in the following way: 

• take the meridian of each annulus of N, 

• take the unique nonseparating two-sided circle on each compo- 
nent of N homeomorphic to a Klein bottle with one hole (cf 
Proposition 2.1), 

• take all the boundary components of components of iV different 
from annuli 
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• for every cylinder C, exterior to N, remove from the above set of 
circles one of the boundary components of C, unless M — Mi. 

By the previous theorem, N is a disjoint union of Klein bottles with one 
hole, skirts, pantalons and annuli, hence by Corollary 3.9, (t ai , . . . , t an ) 
is a finite index subgroup of i*(A4(N)) and by Proposition 2.2, 

It t ) ~ Z n 

In order to show the uniqueness of circles observe that up 

to replacing one of the boundary components of an exterior cylinder 
to N with the second one, the set {a±, . . . ,a n } contains all generic 
two-sided circles in N. Moreover, skipping any of the a^s leads to an 
infinite index subgroup of (t ai , . . . , t an ). □ 

6. COMMENSURABILITY 

Lemma 6.1. Let N and N\ be generic subsurfaces of M which do not 
have isotonic components and do not have components homeomorphic 
to a Klein bottle with one hole. If the geometric subgroups i*(AA(N )) 
and i*(Ai(Ni)) are commensurable then 

(1) every boundary component of Ni is isotopic in M to a boundary 
component of for i = 0, 1; 

(2) there exists a subsurface S of M such that S \N is isotopic 
to Ni and for each boundary component d of S there exists 
a component of N or Ni which is an annulus with meridian 
isotopic to d; 

(3) if a is a generic two-sided circle in iVj then a is isotopic in M 
to a circle disjoint from A r 1 _ i for i — 0,1. 

Proof. We first prove assertion (1). Using the symmetric role of N and 
Ni, we can concentrate on the case % — 0. Let d\, . . . , d n denote the 
boundary components of N , and let be the circles which 

determine P-S decompositions of components of N different from an- 
nuli. Define also b 1: . . . , b k to be the union of circles defining P-S de- 
compositions for components of M \ N different from annuli, and the 
boundary circles of M not isotopic to any di - see Figure 6. If d is one 




Figure 6. Subsurface iVo - Lemma 6.1. 
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of boundary components of iV\, then 

• I(d,di) = for each 1 < % < m. In fact, by commensurability, 
t« = if°(t°) G i^{M{N^)) for some integer a ^ 0, and t d is 
central in if 1 (M(N 1 )). Hence by Proposition 2.3, I(d,cii) = 
(note that we use here the assumption that Ni, hence d, is 
generic) . 

• I(d, bj) = 0, I(d, d{) = for each 1 < j < k, 1 < I < n. The 
reason is similar as before, t% G i*(M(N )) for some integer 
a 7^ and each of h^t^ commutes with all of i*(M.(N )). 

Therefore by Proposition 2.4, we can assume that d is disjoint form each 
of aj, bj, d\. Therefore d lies entirely in one of the connected components 
of M \ (U^Li a i U Uj=i U UILi di)- Therefore d is isotopic to one of 
a ii bj, d\. 

Now we are going show that d can not be isotopic to bj. Suppose 
on the contrary that d ~ bj. By commensurability, G i*(.M(iVo)) 
for some integer a ^ 0. Hence by Lemma 4.2, d ~ &j is isotopic to a 
boundary component of iVo, which is a contradiction with the definition 
of bj. 

Next suppose that d ~ a^. By Proposition 3.10, there exists a generic 
two-sided circle e in iVo, such that I(e, d) = I(e, a«) > (we use here 
the assumption that iVo does not have a Klein bottle with one hole as 
a component). Now G i*(M. (Ni)) for some integer a / 0. Since 
t d is central in M(Ni), Proposition 2.3 implies that I(e,d) = 0, a 
contradiction. 

Therefore, d is isotopic to d\ for some I — 1, ... ,q. 

We now turn to the proof of (2). For % G {0, 1} define 

to be the smallest set of circles in M with the following properties: 

• for every component U of iVj which is not an annulus or which is 
an exterior cylinder to iVi_j, C« contains boundary components 
off/; 

• for every component U of iVj which is an annulus and not an 
exterior cylinder to iVi_j, C« contains this boundary component 
dolU which is closer to iV\_j, in the sense that after an isotopy 
of U in M which takes d to a boundary component of iVi_j (such 
an isotopy exists by statement (1)), the second boundary circle 
of U is disjoint from A r i_j (since U is not an exterior cylinder 
of Ni-i, only one boundary component of U can satisfy this 
condition). 
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By statement (1) and Proposition 2.5, uq = n\ and there exists an 
isotopy of M which takes Cq to C\. Therefore we can assume that 
Cq — C\. 

We claim that Nq D Ni = Cq. Suppose on the contrary that the 
interiors of U and U\ intersect, where Uq and U\ are some components 
of N and Ni respectively. If U\ % Uq then some boundary component 
of Uq intersects the interior of Ui, hence it is not in Cq. Therefore Uq is 
an annulus and we obtain a contradiction with the construction of Cq. 
In fact, this contradicts the assumption that Cq contains the boundary 
component of U which is "closer" to iV\. 

Similarly we argue that U\ C Uq, hence Uq = U\ which is a con- 
tradiction with the assumption that iVo and N\ do not have isotopic 
components. 

Ther efore N n JVi = C , and if we define S = N U JVi then JVi = 
S\N . Moreover, the boundary components of S are exactly the 
boundary components of iVo and Ni which are not in Cq, and by con- 
struction of C , they are boundary components of annuli of N and 
N ± . 

Assertion (3) is an immediate consequence of (2). □ 

The following lemma can be thought as a partial converse to Propo- 
sition 2.10 - cf Example 2.11. 

Lemma 6.2. Let Uq, Ui, U be generic subsurfaces of M such that Ui fl 
U = and Ni = U U U is a generic subsurface of M for i — 0, 1 - 
see Figure 7. Let Ui be a surface obtained from Ui by adding a regu- 




FlGURE 7. Subsurfaces iVo and N\ - Lemma 6.2. 

lar neighbourhood of each boundary circle of U which is isotopic to a 
boundary circle ofU\_i but not isotopic to a boundary circle ofUi, for 
i = 0,1. Then Uq,U\ are generic subsurfaces of M and i*(AA(N )) is 
commensurable to i*(M.(Ni)) if and only if i*(Ai(Uo)) is commensu- 
rable to i*(M(Ui)). 
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Proof. The "if" clause is an easy consequence of Corollary 3.9 and 
Proposition 2.10, hence we concentrate on the "only if" part. 

Assume that the groups i*(Ai(No)) and i*(J\4(Ni)) are commensu- 
rable. Since i i ,(M(N ))r\i il ,(M(N 1 )) has finite index in both i*(M{N )) 
and i*(A4(Ni)), by Proposition 2.8, 

i*(M(N )) n i^MiNi)) n n(M(Ui)) = i*(jW(iVi_j)) n i*{M(Ui)) 

is of finite index in i*(.M (£/»)) for % = 0,1. Therefore it is enough to 
show that 

(2) i^MiN^ni^MiUi)) = i*{M{U ))ni*{M{Ui)) for i = 0, 1. 

Using the symmetric role of Nq and Ni, we will restrict ourselves to 
the case i — 0. Let &i , - - - , 6fc be all the circles which are boundary 
circles of both [/ and C/ , and which are not boundary circles of JJ\ - 
see Figure 7. 

Applying Proposition 4.4 with N = Ni, U = U, K = U and 

f euiMiN^m^MiUo)), 

we obtain 

/ = <•••*£> 

where g G i*(.M(£/i)). Hence / G i*(A^(C/i)), which completes the 
proof of equality (2). □ 

Theorem 6.3. Let N and Ni be generic subsurfaces of M such that no 
component of N is isotonic to a component of N ± . Then the geometric 
subgroups i*(AA(N )) and i*(M.(Ni)) are commensurable if and only if 
they are virtually abelian with the same set of basic circles. 

Proof. The "if" clause follows from Corollary 5.2. Hence we concen- 
trate on the "only if" clause, that is assume that i*(Ai(N )) and 
i*(-M(iVi)) are commensurable. 

Observe that by Corollary 5.2, it is enough to show that both of these 
groups are virtually abelian. In fact, if this is the case, then the set of 
basic circles for i*(A^(A r o)) is also a set of basic circles for i*(M.(Ni)). 

Our next claim is that it is enough to consider only the case when Ao 
and Ni do not have connected components homeomorphic to a Klein 
bottle with one hole. In fact, suppose that N has a component K 
homeomorphic to a Klein bottle with one hole. Let N be a surface 
obtained form N by removing K and adding: 

- regular neighbourhood of a nonseparating two-sided circle in K, 

- regular neighbourhood of a boundary component of K if this 
boundary component is not isotopic to a boundary component 
of N Q \K. 
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Then Nq is a generic subsurface. Moreover, by Corollary 3.9 and 
Propositions 2.1 and 2.10, the geometric subgroups i*(M.(N )) and 
i*(M.(N )) are commensurable, hence it is enough to prove that both 
i*(AA(N )) and i*(M.(Ni)) are virtually abelian. Moreover, if N and 
Ni have common (up to isotopy) connected component C, then C must 
be one of the annuli added to Nq\K. Hence by Lemma 6.2, it is enough 
to prove that i*(M.(N \ C)) and i*(M.(Ni \ C)) are virtually abelian. 
If N \ C and Ni\C still have a common connected component (i.e. 
the second of the added annuli), we can remove it as before. 

Therefore, by repeating the above procedure of removing Klein bot- 
tles with one hole, we can assume that neither N nor Ni have compo- 
nents homeomorphic to a Klein bottle with one hole. 

In order to finish the proof of the theorem, assume that some compo- 
nent U of iVo is not a pair of pants, skirt nor annulus. Then there exists 
a generic two-sided circle a in U which is not isotopic to a boundary 
component. By statement (3) of Lemma 6.1 and by Lemma 4.2, a is 
isotopic to a boundary circle of N ± , hence by statement (1) of Lemma 
6.1, a is also a boundary circle of Nq, which is a contradiction with 
the definition of a. Therefore, by Theorem 5.1, i*(Ai(No)) is virtually 
abelian. Clearly the same is true for i*(M.(Ni)). □ 

The following example shows that the statement of Theorem 6.3 
would be significantly more complicated if we did not require N and 
iVx to be generic. 

Example 6.4. Let M be a torus with two punctures z , Z\ and let iVj 
be a complement in M of a small disk around Z; L for i = 0,1. Since 
A4(M) is generated by twists about the meridian and longitude of M, 
i*(M(N )) = i^(M(N 1 )) = M(M) despite the fact that this group is 
not virtually abelian. 

7. COMMENSURABILITY - GEOMETRIC INTERPRETATION 

Keeping in mind Theorem 6.3 and Lemma 6.2, we obtain a general 
construction of generic subsurfaces N and Ni such that i*(Ai {N )) 
and i*(A4(Ni)) are commensurable. In fact, start with two sets iVo 
and Ni consisting of skirts, pantalons, annuli and Klein bottles with 
one hole. Then glue elements of N to elements of Ni along some of the 
boundary components, denote the obtained surface by S. In order to 
make the groups i*(Ai(No)) and i*(A4(Ni)) commensurable we need 
to ensure that the boundary twists of S and nonseparating two-sided 
circles in components of S homeomorphic to Klein bottles with one 
hole are both in i*(M.(N )) and i^,(M(N 1 )). The case of a generic 
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nonseparating two-sided circle a in a component K of N which is a 
Klein bottle with a hole, can be fixed by adding to N x _i either a regular 
neighbourhood of a or a complement of a neighbourhood of a in K, for 
i — 0,1. In order to fix the problem with boundary components of S 
we can iterate the following technics: 

• we can add an arbitrary surface U, disjoint from N U Ni, to 
both iVo and JVi; 

• suppose that d is a boundary component of S which is in JVj, 
then add to A^" 1 _ i a regular neighbourhood of d, for i — 0,1. 

Finally, embed obtained surface Nq U Ni in some surface M in such a 
way that N and Ni are generic subsurfaces. 

Our next goal is to prove that the described construction of N and 
Ni is as general as possible, i.e. that every pair of generic subsurfaces 
which lead to commensurable geometric subgroups can be constructed 
in that way. However, in order to simplify the formulation, we divide 
the statement into two steps (Theorems 7.1 and 7.3 below). 

Theorem 7.1. Let N and Ni be generic subsurfaces of M such that 
no component of N is isotonic to a component of N\. Assume also 
that no component of Nq or Ni is a Klein bottle with one hole. Then 
the geometric subgroups i*(JA(N )) and i*(Ai(Ni)) are commensurable 
if and only if 

(1) each component of N and Ni is a skirt a pantalon or an an- 
nulus; 

(2) there exists a subsurface S of M such that S \N is isotopic to 
N i; 

(3) for each boundary component d of S there exists a component 
of Nq or N\ which is an annulus with meridian isotopic to d. 

Proof. Conditions (l)-(3) clearly imply that N and Ni are virtually 
abelian with the same set of basic circles, which proves the "if" clause. 

The "only if" clause is an immediate consequence of Theorem 6.3 
and assertion (2) of Lemma 6.1. □ 

As an immediate corollary we obtain the following natural generali- 
sation of Theorem 6.5 of [13]. 

Corollary 7.2. Let N and Ni be generic subsurfaces of M such that 
no component of N is isotopic to a component ofNi. Assume also that 
neither N nor Ni has components homeomorphic to either a Klein 
bottle with one hole or an annulus. Then the geometric subgroups 
i*(A4(No)) and i*(M(Ni)) are commensurable if and only if M has 
no boundary, each component of N and of Ni is a pantaloon or a skirt 
and M \Ni is isotopic to Nq. □ 
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Theorem 7.3. Let N and Ni be generic subsurfaces of M such that 
the geometric subgroups i*(AA(N )) and i^(A4(N 1 )) are commensu- 
rable. Let Ui, . . . ,U P be the set of all common (up to isotopy) connected 
components of N and Ni . Let K itl , . . . , K i q . be the only connected com- 
ponents of N- = Ni\\Jj =1 Uj which are homeomorphic to a Klein bottle 
with one hole, fori = 0, 1. Then there exists a component la-ij ofN[_ t 
which is isotopic to either a regular neighbourhood of the nonseparating 
two-sided circle in K it j or to the complement of this neighbourhood in 
Kij, for j — 1, . . . qi and i — 0, 1. 

Moreover, for i — 0,1, let iVj be a surface obtained from 

Ni = Nl\ (U^ U UM 

\j=i j=i J 

as follows: for each U G {U x , ...,U P , K 0A , K 0m , K 1A , K hqi }, 
and for each boundary component d of U which is isotopic in M to a 
boundary component of iV"i_j and is not isotopic to a boundary compo- 
nent of Ni, add a regular neighbourhood of d to TV,. Then N and Ni 
satisfy the assumptions of Theorems 6.3 and 7.1. Moreover, i*(M.(N )) 
is commensurable to i*(J\A(Ni)) . 

Proof. By Lemma 6.2, up to adding some annuli, surfaces iVp and N[ 
satisfy the assumptions of Theorem 6.3. By Theorem 5.1, the compo- 
nents of Nq and N[ are Klein bottles with one hole, pantaloons, skirts 
or annuli. Moreover, by Corollary 5.2, the sets of basic circles coincide. 
Therefore, if i — 0, 1, 1 < j < p and a is the nonseparating two-sided 
circle in K it j, then a is isotopic to a circle in some connected compo- 
nent Li_ it j of iVi_j. Therefore, is isotopic to either a regular 
neighbourhood of a or to its complement in K it j. 

The fact that Nq and Ni do not have common connected components, 
and that they do not have Klein bottles with one hole as components 
is obvious. Moreover, by Lemma 6.2, i*(M.(N )) is commensurable to 
i*(M(N!)). □ 

Corollary 7.4. Let N and Ni be generic subsurfaces of M which do 
not have skirts, pantalons nor annuli as connected components. Then 
the geometric subgroups i*(A4(N )) and i*(M.(Ni)) are commensurable 
if and only if N is isotopic to N x . □ 
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8. COMMENSURATOR OF A GEOMETRIC SUBGROUP 

Our next goal is to describe the commensurator Comm(?*(.M(A r ))) 
of the geometric subgroup corresponding to an arbitrary generic sub- 
surface N. The first guess could be that this commensurator should be 
close to the stabiliser of N 



In fact it is known that this is the case for M orientable, and iV injective 
and connected - cf Theorem 7.1 of [13]. However, as is shown in the 
following example, the index 



can be arbitrary large. 

Example 8.1. For n > 3, let M be a sphere with 3n punctures, em- 
bedded in R 3 in a rotationally symmetric manner indicated in Figure 8 
(this figure shows the case n — 3, in order to imagine the general case 
just think of n "branches" instead of 3). The same figure indicates 



FIGURE 8. Sphere with 3n punctures - Example 8.1. 

a generic subsurface N (the shaded region), it consists of n "outer" 
doubly-punctured disks, "the core" of M (which is a sphere with n 
holes) and one punctured annulus. Now it is clear that the natural 
rotations of M provide n elements of Comm(i*(.M (AT))) (even of the 
normaliser of i*(.M(iV))) that represent different cosets of Stab (AT). 
Hence 



Despite the above example, we can still provide a descent character- 
isation of Comm(i* (M.(N))) but we need to "redefine" the stabiliser 



Stab(iV) = {f E M(M) | f(N) is isotopic to N} 



[Coming (.M (iV))) : Stab(JV)] 




[Comm(u(M(N))) : Stab(iV)] > n 



of N. 
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Definition 8.2. Let Ui, . . . ,U P be all connected components of a generic 
subsurface N which are not annuli, skirts, pantalons nor Klein bottles 
with one hole. Denote also by C the set of isotopy classes of the union 
of basic circles for the subsurface N \ |Jf =1 U and the boundary circles 
o/UiLi Ui- Define Stab*(iV) to be the subgroup of M.{M) consisting of 
these classes of diffeomorphisms f : M — > M for which f (Uf=i Ui) is 
isotopic to UiLi Ui> an ^ f(C) is isotopic to C. 

Theorem 8.3. Let N be a generic subsurface of M. Then 

Comm(u(M(N))) = Stab*(JV). 

Proof. The inclusion Stab*(iV) C Comm(i*(J\4(N))) is obvious, hence 
we concentrate on the second one. Let / G Coming (.M (N))), that 
is i*(M.(N)) and i*(M(f(N))) are commensurable. By Theorem 7.3, 

the subsurfaces N and f(N) (constructed as in the statement of that 
theorem) have commensurable geometric subgroups, no common com- 
ponents and no components homeomorphic to a Klein bottle with one 
hole. Hence by Theorems 6.3 and 5.1, each component of N and of 

f(N) is an annulus, a skirt or a pantaloon. Moreover, the sets of ba- 
sic circles for these surfaces must coincide which easily leads to the 
conclusion that / G Stab*(iV). □ 

Theorem 8.4. Let N be an injective subsurface of M such that no 
component of N is a Klein bottle with one hole or an annulus. Then 

(1) Comm(u(M(N))) = Stab(iV) xi Z 2 if M is closed, i*(M(N)) 
is virtually abelian and there exists a diffeomorphism 

a: N -> M\N 

such that a G M(M); 

(2) Comm(i,(A^(JV))) = Stab(iV) otherwise. 

Proof. The inclusion Stab(iV) C Coming* (.M(iV))) is obvious, hence 
it is enough to prove that if there exists an element 

a G Comm(u(M(N))) \ Stab(iV) 

then Comm(i*(.M(iV))) = Stab(iV) xi Z 2 and iV is as described in (1). 

Let U = {Ui, . . . , U p } be the set of all components of iV such that 
a G Stab(C/j) for % = 1, . . . ,p. By Lemma 6.2, N' = N \ U and 
o~(N') = o~(N) \ U have commensurable geometric subgroups (we use 
here injectivity of N). Hence N' and c(N') satisfy the assumptions 
of Corollary 7.2, which implies that M is closed, cr(N') is isotopic to 
M\N' and N' is virtually abelian. Therefore, U = 0, N = N' and we 
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have an exact sequence 

1 ► Stab(iV) ► Comm(u(M(N))) — Z 2 ► 1 

where Z 2 = {1, -1} and n(h) = -1 iff h(N) is isotopic to M\N for 
h G Comm(U(M(N))). 

It remains to show that the above sequence splits. In order prove 
this, embed N in 

IR 4 = {(x 1 ,x 2 ,x 3 ,x 4 ) I xi,x 2 ,xs,x 4 e IR} 

in such a way that: 

• the interior of N is contained in the set x 4 < 0, 

• the boundary of N is contained in the plane x 3 = x 4 = 0, 

• each boundary component of N is a metric circle with the center 
on the x\ axis. 

Now if a : IR 4 — > IR 4 is the half turn about the xi-axis, that is 

<r(xi, x 2 , x 3 , x 4 ) = (xi, -x 2 , -x 3 , -x 4 ), 

then U CT <r(A r ) is a model for M in which — 1 i— > a provides a section 

s: Z 2 -> Comm(^(7W(iV))) 

of 7r defined above. □ 

Remark 1. One can easily see that the semi-direct product in part (1) 
of the above theorem is a direct product if and only if each component 
of N is a pantalon of type II or III, or else a skirt of type II. 

9. Irreducible representations 

As we indicated in the introduction, the mapping class group Ai(M) 
acts on the complex of curves C(M) and this action produces a very in- 
teresting and important family of subgroups of JA(M), namely the fam- 
ily of stabilisers of simplexes in C(S). Since such a stabiliser Stab (cr) 
contains a geometric subgroup i*(A4(M a )) as a subgroup of finite index 
(cf Example 3.5), we can apply the results from previous sections to 
the study of these stabilisers. In particular we will show that under 
some natural assumptions, 

(3) Stab(<T ) is commensurable to Stab(cr 1 ) 0-0 = 0"!. 

Then using the results from [2], we will draw some interesting con- 
clusions concerning irreducible unitary representations of Ai(M). In 
the orientable case, equivalence (3) was proved in [12] by means of the 
"large action" of the mapping class group on C(S) (in the sense of [2]). 
However, in the nonorientable case there are new phenomena we need 
to deal with. 
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The first one is that keeping in mind Example 6.4, we do not want 
to deal with subsurfaces which are not generic, hence we will restrict 
ourselves to the complex Cq(M) of two-sided circles in M (cf Example 
3.5). This is a full subcomplex of C(M) in the sense that if the set of 
vertices in Cq{M) is a simplex in C(M) then it is a simplex in Cq{M). 

The second phenomenon is illustrated by the following example. 

Example 9.1. Let L be a surface with two boundary components c\ 
and C2 which is not an annulus. Construct a surface M by gluing the 
boundary circle of a Klein bottle Ki with one hole to q, for % — 1, 2, and 
let ai,a2 be the nonseparating two-sided circles in K\ and K% respec- 
tively - see Figure 9. If we define the simplexes uq = {ci,C2,ai} and 



FIGURE 9. Simplexes of C (M) with commensurable 
stabilisers - Example 9.1. 

°i — { c i) c 2, a-i, 0,2} then by assertion (1) of Proposition 2.1, Stab(oo) C 
Stab(cri). Moreover, Stab(a ) is the kernel of a homomorphism 



defined by $(/) = —1 iff / interchanges ci and C2 for / e Stab(ci). 
Therefore [Stab(a"i) : Stab(cro)] = 2, hence these stabilisers are com- 
mensurable despite the fact that a ^ a±. 

The above example motivates the following definition. 

Definition 9.2. A simplex a = {ao, • • • , ctn} of the complex Cq(M) is 
reduced if for each i — 0, . . . , n, no component of M \ is a Klein bot- 
tle with one hole. The reduced complex of curves, denoted by Cl ed (M) 
is a subcomplex of C (M) consisting of reduced simplexes. 

As is shown in the next proposition, the complex CQ ed (M) is a very 
natural subcomplex of C (M). 

Proposition 9.3. Suppose that M 7^ M_ 4 . Then the realisation of the 
reduced complex of curves |CQ ed (M)| is a strong deformation retract of 
the realisation \C (M)\ of the complex of two-sided curves. 




L 



$: Stab(o-i) -> Z 2 
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Proof. For any vertex v of Cq(M) define 

' v if no component of M \ v is a Klein bottle with one hole; 

^ . . c if one of the components of M \ v is a Klein bottle K 
$(v) = { 

with one hole, and c is the unique 
nonseparating, two-sided circle in K. 

Note that by our assumption M ^ M_ 4 , there is no ambiguity in the 
above definition. We claim that $ can be extended to a simplicial map 
$: Co(M) — > CQ ed (M). In order to show this, we need to check that 
if er = {c , . . . , c n } is a simplex in C (M) then {$(c ), . . . , $(c n )} is a 
simplex in Cq^M) (possibly of smaller dimension). Hence it is enough 
to show that /(<&(cj), <&(cj)) = for 2 7^ j. This is trivial for circles 
which do not cut off a Klein bottle with one hole, so we can assume 
that one component K of M \ Klein bottle with one hole. Then 

Cj is either the unique nonseparating two-sided circle in K or Cj is a 
two-sided circle in M \ K. In the first case $(cj) = $(cj) and in the 
second case, using Lemma 2.6, it is straightforward to check that $(cj) 
must be contained in M \ K, hence $(cj) is disjoint from $(q). 

It remains to show that $ is a strong deformation retraction. By the 
basic properties of weak topology (cf Chapter 3 of [14]), it is enough 
to consider the restriction of $ to an arbitrary simplex a G C (M). 
By Proposition 2.1 and Lemma 2.6, a' = a U $(cr) is also a simplex in 
Cq(M) and $ restricted to o' is just a simplicial projection onto the 
face of a' spanned by vertices that are in C^ d . □ 

Proposition 9.4. Let o~ , o\ G CQ Sd (M) be reduced simplexes such that 
Stab(o" ) and Stab(eri) are commensurable. Then o~$ = o\. 

Proof. It is an easy observation that for any a G Co(M), i*(Ai(M a )) is 
a finite index subgroup of Stab(cr), where M G is defined as in Example 
3.5. Hence the geometric subgroups i if (M(M crv )) and i*(A4(M .J) are 
commensurable and neither M ao nor M ai contains components home- 
omorphic to an annulus or a Klein bottle with one hole. If Ui, . . . , U p 
are all (up to isotopy) common connected components of M UQ and M ai , 
then by Theorem 7.3, M' ao = M ao \ \J p i=1 Ui and M' ai = M ai \ \J i=l Ui 
satisfy the assumptions of Theorem 6.3. Therefore i*(M.(M' )) and 
i*{AA{M' ai )) are virtually abelian with the same set of basic circles, 
which easily leads to the conclusion that <7o = <J\. □ 

As we have already indicated, the above proposition has very inter- 
esting consequences in terms of unitary irreducible representations of 
mapping class groups. In order to state the result, we need to recall 
the appropriate terminology and notation - see [2] . 
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For a countable discrete group G, let G be the unitary dual of G, that 
is the set of equivalence classes of irreducible unitary representations of 
G. By G fd we denote the subspace of G of equivalence classes of finite 
dimensional representations. Among the basic properties of irreducible 
representations is the following proposition (for a more complete state- 
ment and references see [2]). 

- — f d 

Proposition 9.5 (Mackey [11]). Let Ti G Hi be a finite dimensional 
irreducible unitary representation of a subgroup Hi of a countable and 
discrete group G for i = 0,1. Assume also that Comm(i^j) = Hi for 
i = 0,1. Then 

(1) the induced representation Indf^fji) is irreducible for i — 0,1, 
hence we have a well defined injective map 

lnd G Hi :Hi d ^G- 

(2) if in addition H and Hi are not conjugate in G, then /nrf^ () (r ) 
and Indff^Ti) are not equivalent, hence we have a well defined 
injective map 

- — fd —fd — 

H UHi ^G. 

□ 

A careful reader may noticed that in the original [2] statement of (2) 
there is an assumption that H and Hi are not quasi-conjugate. How- 
ever it is not hard to check that under our assumption Comm(Hi) = Hi, 
Hq and Hi are quasi-conjugate if and only if they are conjugate. 

As is shown in [2], there is an efficient way of constructing large 
families of subgroups of G satisfying the assumptions of the above 
proposition by means of so called N.C.S. actions of G. 

Definition 9.6 (Burger, de la Harpe [2]). Let G be a countable dis- 
crete group acting on a space X. The action of G on X is an action 
with noncommensurable stabilisers ('N.C.S. action in short) if different 
points of X have noncommensurable stabilisers. 

Proposition 9.7 (Burger, de la Harpe [2]). Let G x X — > X be a 
N.C.S. action of a countable discrete group G. Then unitary induction 
provides a well defined injective map 

\\ StlMxjf d ^G 

xex/G 

where X/G is the orbit space. □ 

Combining the above proposition with Proposition 9.4 leads to the 
following corollary. 
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Corollary 9.8. The action of the mapping class group M.{M) on the 
reduced complex of curves C r Q ed (M) has noncommensurable stabilisers 
in the sense of [2]. Therefore unitary induction provides a well defined 
injective map 

jj Stab(V)/ rf M{M) 

aeC[ ) ed (M)/M(M) 

□ 

As we indicated before, the above corollary was proved in [12] for an 
orientable M. 



References 

[1] J. S. Birman. Mapping class groups and their relationship to braid group. 

Comm. Pure Appl. Math., 22:213-238, 1969. 
[2] M. Burger and P. de la Harpe. Constructing irreducible representations of 

discrete groups. Proc. Indian Acad. Sci., 107:223-235, 1997. 
[3] D. R. J. Chillingworth. A finite set of generators for the homeotopy group 

of a non-orientable surface. Math. Proc. Cambridge. Philos. Soc, 65:409-430, 

1969. 

[4] D. B. A. Epstein. Curves on 2-manifolds and isotopies. Acta Math., 115:83- 
107, 1966. 

[5] M. Korkmaz. First homology group of mapping class groups of nonorientablc 
surfaces. Math. Proc. Cambridge. Philos. Soc., 123(3):487-499, 1998. 

[6] M. Korkmaz. Mapping class groups of nonorientable surfaces. Geom. Dedicata, 
89:109-133, 2002. 

[7] C. Labruere and Luis Paris. Presentations for the pucturcd mapping class 

groups in terms of Artin groups. Algebr. Geom. Topol., 1:73-114, 2001. 
[8] W. B. R. Lickorish. A representation of orientable combinatorial 3-manifolds. 

Ann. of Math., 76:531-540, 1962. 
[9] W. B. R. Lickorish. Homeomorphisms of non-orientable two-manifolds. Math. 

Proc. Cambridge. Philos. Soc, 59:307-317, 1963. 
[10] W. B. R. Lickorish. A finite set of generators for the homeotopy group of a 

2-manifold. Math. Proc. Cambridge. Philos. Soc, 60:769-778, 1964. 
[11] G. W. Mackey. The theory of unitary group representations. Chicago Lectures 

in Mathematics. The University of Chicago Press, 1976. 
[12] L. Paris. Actions and irreducible representations of the mapping class group. 

Math. Ann., 322:301-315, 2002. 
[13] L. Paris and D. Rolfsen. Geometric subgroups of mapping class groups. J. 

Peine Angew. Math., 521:47-83, 2000. 
[14] E. H. Spanier. Algebraic topology. McGraw-Hill Book Co., 1966. 
[15] M. Stukow. Mapping class groups of nonorientable surfaces with boundary. 

Preprint. 

[16] M. Stukow. Dehn twists on nonorientable surfaces. Fund. Math., 189:117-147, 
2006. 



E-mail address: trojkat@math.univ.gda.pl 



COMMENSURABILITY OF GEOMETRIC. 



31 



Institute of Mathematics, University of Gdansk, Wita Stwosza 57, 
80-952 Gdansk, Poland 



